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INTRODUCTION 

This paper computes the partial derivative of the scaler function 
$ ■ tr(BAB^) - tr{M^[ (BAB^) ^ - (BDB^) ^ - 1^]} with respect to the matrices 
B and D where : 

tr ; the trace of a matrix 
B } a k by n real matrix of rank k £ n 
A ; an n by n positive definite, real symmetric matrix 

M ; a real k by k symmetric matrix (assumed to be constant) 

D j an n by n positive definite diagonal matrix 

j the k by k identity matrix 
DISCUSSION - Define the scaler 

*1 - \ tr (BAB T ) 

3* x 3$. 

We use the notation -rr— to denote the matrix (rr — ) where B - (b. .) 

dB ob . . ij 



T 

But for any square matrices and A 2 , trCA^ * tr(A i ) and 

tr(A^ + A 2 ) - tr(A^) + tr(A 2 ) so that 





2 


where AB ■ (pt^) 


Thus it f ollow8 


3b~ ■ and thus 




3*. \ T 

as y ■ v -v" 


proving the Lemma. 


Lemma 2: 


— (BAB 1 )” 1 - -(BAB T ) 1 [ — (BAB T )] (BAB T ) 1 where B 

ij ij 


Proof: Since (BAB T ) (BAB 1 )" 1 = I k , it follows 

[ (BAB T ) KBAbV 1 + (BAB T ) [ - (BAB 1 )" 1 ] = (0) 


so that 


(BAB T ) -1 - - (BAB T ) _1 [ (BAB T ) ] (BAbV 1 

3b ij 3b ij 


as desired. 


Lemma 3 - Let $ 2 = 1 t r[M T (BAB T )" 1 ] . Then 


'"I " ,B ft 


ft)’ 


-Ab t (bab t ) _1 m t (bab t ) _1 


1 m m 1 

3b^ ■ 3b^ I “»*»*»*>-*] 


- ~ tr!M T -g—- (BAB 1 )" 1 ] 
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- - i tr{M T (BAB T )" 1 [ -rr~- (BAB T ) ] (BAB T ) (Lemma 2) 

2 3b ij 

- - i tHt^CBAB 1 )" 1 ! |~- AB T + BA-J 5 -] (BAB 1 ) -1 } 

2 3b ij 9b ij 

- - i tr{ AB T (BAB T ) -1 M T (BAB T ) -1 } 

2 3b ij 

- tr{(BAB T )“ 1 M T (BAB T )' 1 BA || — } 

2 3b ij 

- -tr{ |£— AB T (BAB T ) -1 M T (BAB T ) _1 } 

3b ij 


-Y 


ji 

where (y. .) = AB T (BAB T ) - 1 M T (BAB T ) _1 so that the Lemma follows since 


I ’ 1 3 b ij) 


-(Yjl) 1 - -(Yjj) - -AB T (BAB T )“V(BAB T ) 1 


Now define the scaler 


$ 3 - tr[M T (BDB T ) -1 ] 

3$ 3 

and we use the notation — to denote the matrix of partial derivatives 


V\ 

94 « / 


where D ■ (d^) 


T T —1 

- /. t-c A _ a-T Tvr f ' 1 

kama a " 11 ^3 / j» ^.n^n 


3 $ 


--B T (BDB T ) - 1 M T (BDB T ) -1 B so that whenever 
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30 

BB T - I k , 0 3 - -trlBD B T ] 


30, 


Proof: - tr[M T (BDB 1 ) -1 ] 


3d 


ij i-i 

-tr{M T (BDB T ) _1 [ ~~ <BDB T )] (BDB 1 )" 1 } 

3 ij 

-tr{M T (BDB T ) -1 (B B T ) (BDB T ) -1 } 


ij 


But for any two matrices A^, A 


tr(A^ 2 ) » tr(A 2 A^) whenever both matrix products are defined; 


thus letting 


A. - M T (BDB T ) 2 B and A, - B I (BDB 1 )" 1 . 

1 2 Sd ij 


it follows 


30 

- -tr{ B T (BDB T ) -1 M T (BDB T )" 1 B} 

3d ij 3d ij 


and as in Lemmas 1 and 3 it follows 


30 3 

3D - 


ft) 


-b t (bdb t ) 1 m t (bdb t )" 1 b 


Lemma 


T 

_5 - If 0^ » An] BAB | corresponds to the natural logarithm of the 


determinant of BAB , then 


. ft) 


Ab t (bAb t ) _1 
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r^v 

and thus Bl-gj-J - I k 


Proof: Let X^,.,,,X k be the strictly positive eigenvalues of BAB , so 


4> 4 - | £n|BAB T | - | . . . ,X n ) 


and thus 


1 9b ii 


V ,,x k-i 



x r* ,A k 


, 3b., 

1 H 


-r tr{W ^ -|r — } where 
2 


is a diagonal matrix 


of eigenvalues of BAB 

But since (BAB -1 ) is a real symuetric matrix, there exists an orthogonal 
matrix U satisfying 


U(BAB T )U T - W and UU T - 
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(Note (BAB 1 )" 1 - U T W _1 D). Thus 


|~- (BAB T )U T + U[ (BAB T )]U T 
3b ij 3b ij 


+ U(BAB T ) Jjj- 


and thus 


" T IF u - » T f- « mT > + 

3b ij 8b ij 3b U 


+ <■“*> IF 0 


ov 4 1 _ f „-l 3W ! 

■fTC — “ trtW -yr — > 

3b lj 2 Sb i3 


1 trftrVW f- b> 

2 ab ±j 


- i tr{(BAB T )' 1 [U T |S— (EAB T ) + -gr-^-CBAB 1 ) + (bAb T )|S— U]> 


\ «<“ T H77 + + 1 “i w*')' 1 ^ babI » 


_ ^ . v ■ I, , it follows 

But since U U k* 


0* |2- + |2-o - 0, .oth.t 

8b y 3b u 
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34 > 

5 

3b 


ij 


\ tr[(BAB T ) _1 -rr— “(BAB 1 ) ] 
2 . 3b ±J 


- tr[ 


3B 


9b 


ij 


AB T (BAB T ) _1 ] so that 


( 



T 


AB T (BAB T )“ 1 , 


completing the proof. 


Now, recall the definition of the function 


* - tr(BAB T ) - tr{M T [(BAB T ) -1 - (BDB T ) 1 - I fc ) - 2^ - 2$ 2 + $ 3 + tr{M T } 


But 



(Lemma 1) 


(Lemma 3) 


- -2DB T (BDB T )’" 1 M T (BDB T ) -1 

“g| - -b t (bdb t )" 1 m t (bdb t )" 1 b 

3$ x 3$ 2 

3D " 3D 



(Lemma 3) 


(Lemma Q 


0 
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so that 


f aA T 2 ( 

l 9B J ~ 1 \3B J 


- 2 


30 T 

3 ^ 


/a* 3 \ 
(alT / 


2AB T [I k + (B bW(B B 1 ) -1 ] 


- 2DB T (BDB T )~ 1 M T (BDB T ) 


-1 


and 


sA /aA 1 

3D j i 3D j 


b t (bdb t )“ l m t (bdb t ) _1 b 


where we have assumed 


3M T _ 3M^ 
9B “ 3D 


ADDITIONAL CONSIDERATIONS 


Consider the problem of maximizing 


X = tr(BAB T ) 


T 

subject to the constraint 1^ - BAB is positive definite. 

T 

Since ]^- BAB is symmetric, there exists an orthogonal matrix Q 
satisfying 

Q(I k - BAB T )Q T « 

T T 

and QQ - I k , and S is a diagonal matrix of eigenvalues of I k - BAB . 

Thus the constraint is equivalent to A^ > 0 for all i. Also, 
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X « tr (BAB T ) 

T T 

« tr(QBAB Q. ) (for any orthogonal matrix Q) 

- trdtif) 

where & « QB is a k by n matrix 
It follows £ satisfies 

I, - £a£ T - S 
k 

so that the row vectors of £ may always be chosen A orthogonal. Alternately, 
let 



and the constraints are equivalent to 


b^ A bj •» 0 
1 - b* A b ± > 0 

Thus the problem is to maximize 


i = l,...,k~l 
j » i + 1, . . . ,k 

i * 1, . . . ,k 


X - tr (&A§ T ) 


subject to the above constraints. 



Thus it appears the solution to the problem 


max X ■ tr(BAB T ) 

T 

subject to the constraint I fc - BAB is positive definite is given by any 

k eigenvectors * 1 »e 2 \ of A » appropriately "scaled" with scaler 

so that 


1 


21 , 

a e^ Ae^ > 


V 


i 


where we assume 


e i Ae ± ■ 1 




